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Studies conducted by the United States Military 


Academy and Air Force Acadewy Showed that many cadets who had 


attended preparatory schools which prepared high school graduates for 


col.dge adawission performed below what had been predicted by their 
scores on college’ entrance exapinations. Based on these findings, 
about 1,<00 studehts from 10 preparatory schools participated in a 


» 


study to deterrgine the erfect of preparatory school test coaching on 
college entrance examination scores and subsequent performance in 


college. 


scores on the September, 
Aptitude Test (SAT) 
mathematics and English composition were compared. Scores were 


1962 and March, 1963 Scholastic. . 8 
aud Coilege Board ({CEEB) achievement tests in 


correlated with five background variables: intelligence index, number 
of secondary schools attended, number of mathematics and English 


courses, 


and high school rank. Both SAT and achievement -test scores 


increased, with CiEB scores Showing the greater increase. Both SAT 
verbal and mathematics.test scores increased significantly beyond 


what had been considered typical for a senior high school year. 


lso, 


CadetS in the miiitary academies performed significantly poorer Chan 
was predicted Dy CEEB scotes, aS indicated by-an adjusted -correlatioh . 
Of .35. Implications of the study are discussed, and statistical 


analyses of: aspects of the study are appended\ (CP) ; 


® _ 
a » 
‘ 
eg ¥ ¥ . 
FEI CIERICIIOICIOIOIOIOIOISIRIOIOIOIGIOIOIOIIOIOISIUIOIGIOIOIOIOICICIOOIOIGIOIIOIOIOIDIO IOI SIOIIGIOIOIOIGIOIDIOIOIOIOI OCI IO 
* " Repretductions supplied by EDRS are the best that can be made *,. 
es from the original document. * 


: y . 
SOG IGI III GIORGIO IOI IDIOIIOIOIGIOIGIOIOIOR IOIGIOIIOIOIO OR IOIOIO II IOROR RR IOIOR HOO 5 
- ; * ; , vy 


TT tLe L) “— 


tm& 


: , iz ‘ . a i $ 7 e 
. et £ . “ ; . nfarmantor weactH. ‘ 
: e at . %- . * we os Leare ; 
rc - ure vn yi % : wSTvoway iat Ture oF 
eae ye" oy . ‘ : a RoucaTtion . -—— 
ah} i J Tees pecumens HAL BEGN REPRO: 
; ' ‘+ gyce® @RACTLY Ab AECEIVED FROM 
Vig 4 ; ‘ ge Fg * the raha och robin pt Hi 
~ -” 4 
i, STUDY NUMBER I A1l.02-62-001 NY eo cacestanicy RESRE: 
et ; : . : SOMT OF EAMIAL NATIONAL INSTITONE OF 
. b : : i . e qoucatl POSITION, OR POLICY 
sd : “ - = oe : i -t . : ". 
¢ = : . ‘¢ , ' - 
"PREPARATORY scigad TEST. PREPARATION * 
- as 2 ~ 
. o? . e 
P 7 . 4 
-” . t -, ¢ e 
= ei aia cea eal aaa, Me 
a s ; 7 : : 
a v te 
: SPECIAL, TEST PREPARATION, : 
ITS EFFECT ON COLLEGE BOARD SCORES AND THE RELATLONSHIP 7 : ; 
7 _ OF EFFECTED SCORES TO SUBSEQUENT COLLEGE PERFORMANCE 
: as * A 
; a \ \ cy 
f 
% : amas 


. AKO 7 " ; ‘ oy 
- , oh eae Fe wy 
Oy A ye J 
7 , 7 ‘ | 
“ c rans enie + 
SO BEST COPY AVAILABLE ee 
‘ "° 4 , L i 7 ‘ = *. . 4 } 
i os . ; . [ . ‘ Ho 4 
. . | , ’ ° . ; : _ 
re) : - | Oo Py 
60 . . . . : 4 . . . ’ ; cc 
et ¢ *  * — RESRARCH DIVISTON - 
. - OFF R@E OF THE DIRECTOR OF ARMISBIONS AND REGISTRAR 
"| & k UNITED STATES MILITARY ACADEMY 7 , 
so a . WEST POINT, NEW YORK ©, yg 
: * ne i ; " a 4 . F . we . ; : e std 
. , ite. : A 7 an c : wr . Tn) - : 
4 w ; L November 1965 ; ah 
\ ‘i 
. * a \ 
g . ‘ é ; ° : Hs) x : 
> 4 ve P : % jae , rd t 
. = vw < 7 \ 7 vv \ ne % 
a seg ne RE rE Err eer eamenewnrweeer froma ees SNe ; . 
y : 7 a eS Sg y 
"1 S a eae ame eee , yo. ve A "p 
E IC ‘ i 1 s 8 2 ¢ a 


e ° Z e ’ , 
a . . . io ‘ . ; ; 
. & sss LF » ‘ : J , . ; . i a 
ae me : ce, 
= Coe « PROJECT ADMISSION 
‘ , cae , F 5 . . ~ 
oo. . : : "y Study No. I-Al,02-63-001 a ‘ 
~ o¢ ; = “Ss 
<7 Subtask: Preparatory School , 7 
‘ * ° : . C . ; = 
* . we 
~ , ‘ me ay ° = , : ‘ . 
: ae \ ; 
€ ¢ * > , 
¢ e 
nt eee 4 : — a — csistes “ pBse. esas ea ee 22 = tog A eee eee 
, : . : ; a 


Ye r : : ? Prepared By _ f ‘ . . 
oe ‘ . : ‘ . . : ; 7 a t 
e & x : Joseph E. Marron, Ph D, | es 
; : o : t, a 
- i ‘ : ¥ a. 7 os ' 
, yf 
~ ‘ t . = , , 
. ‘ \ ‘ ! 
: ‘ : ' A 
’ ( - ‘ 
. : * \ , mN 
oa | ' & - ‘hy ‘ 7 * 
at . . FY e . . 
‘ : : ee , ; 
4 + : Appr oved ‘By. 
a ; ~ AY 
\ , . i) 8 
; a ’ » ee 
. . Colonel! Robert S. Day ' as 7 
one Director of Admissions and Registrar ° ' 2 
e é * v » 
. “4 a ‘ .; 
- <* The findings in this study are not to be construed as official Depart- 
~ment of the Army posttion unless so Slated in the report. . # . . ¢ 
‘ = 4 . \ ‘ . aan 
’ , a rn ; anes 
. i “ . : / a . : q ‘ : to ‘¢ 
. Please address correspondence concerning distribu ten ot thissrepor t to: ’ 
Research Division, Office jof: the Director of Admigs ions aid Registrar » United _— 
¢ , 
States Mtiitary Academy, st Point, New | York, 10996, . ” 
-* : ; . ‘ 7 . t 
. ed . ‘ . : . cs 
® . es = wv” » 
° , ‘ 7 Y ‘ > f ' 
‘ ; ~ = we TY < 
2 «? t \ 
* r ’ e y 7 
: ° ’ os ' t a a 


9° - . 2 ee : 
ERIC ¢ ‘ # ry ’ ’ " * : x 


ae i oe we e % | 
a a ons oe aa : so 
; <3 SUMMARY - | | a ea —~ * 
4 “14 BACKGROUND: Studies at USMA and (he Air Force Aéadeny tnve:-ehow . ie : 
P that oa tual academic college performanco of many cadets who had taken ean extras _ nate 


preparat ton in, preparatory schools offering courses fortatudonts soek- - 
ing ¢ Llege admission was far below that which would be predicted from their |, re 
44 on Cotteke Board tests, Educational Testing Service had also expressed 
rest in the effects of practice over an exteuded period of time on College 
Board test ne : uO Ss 


a’ , 


a ee In, that some educators teen fo lt that abrendanges at prep~ 


preparatory school are training on eG ldiege entrance examination : 4 
scores and subsequent performunce in college. ° ; . ne el 


t ; 4 
: 


“ -° § 3.) PROCEDURE: Students at’ ten well-known preparatory sehools that 
spec Lal ize. fn preparing htgh schoo! -graduates fdr admission to college were 
dnc huybed | te | the study, Students’ educational backgrounds were studied with fa P 
respect” to “schdo ls attended and couvses taken, College Board tegt scores : ; a... 
: we rg _tompased and relationshins between these test scores and end#of-freshman- 
yor academic performance in both the service academies and Givilian colleges : ee 
' werd studied, \ : ) - 3 . : 
7. a, | : ' s ; ° 
ee 4, RESULTS : a 
ee ee ; i ? 7 = ; t 
. a. Summary. iH College Board achievement test scores 'of candidates” 
sor after preparatory Schgo} attendance were raised fak more ‘than the Coilege | . : 
Board Scholastic Apt i tyjde: Test: an ae sap iowlarly dn mathematics. As a o 
froup, cadets trom pr@paratdry sghools performed significantly poorer than " 
JWas predicted, “Academic ngr Lornitince of the civilian college sample tested ; sings 
was aven poorer than that cof: the service academics Samples. i THare were some 
stgntficant differengps among the preparatory . schools ; particularly with oo 
. cedpect to’ length ane scope of COUrsgs given, . : - . , 
Pile 4 if 
: _ be Conclt 
= on achievement test 
ree obrer ing fa cn=yoar} 
ih the wodphts assign 
— deterylined by' sta 
q acadgmic suceess | 
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pns, Results of this’ study scem to indicate that Bcores 

for applicants who have attended preparatory schools ° 

kurriculum ought, to be tempered or an adjustment made in 

d to soores obtained; Such an adjustment can be casily 

ae to increase the acedlracy with whicl»s 
predicted ie _— - 


\ - 


a? ya 


. c. Recosmendations. fo, - 
; ‘ : / ‘ 
: | , (1) Those preparalory schools’ of fering one-year curriculums; 

for boys secking admission to college would assist the, student mgst il they = ‘ : 


would pear thotr curr teu lums to the sf teshinan: college level, ; 
' : ow ; 


‘ -, » 
* (2) Proparatory schools should adopt -a poltcy of roquiring 


+ -atudents ‘to stay on until the end of May rothor dhan terminat ing thoir ee 
training in January or March after the administratign of the College Board. ° its sha 
’ . tests, ‘Such a proceedure shou ld ephance theo stutiont ' college performance rays I 
a a dur ing Sean year. - Ae) ° - : , an) Sesantcomaimt 
od . ; ‘ ; a ; : poss a : 
: : ay Since attenwance ‘at a preparatory school snuwupale a ite % 
= motivation 6 enter the United States Military Academy, a study of Aptitude beet ‘ ‘ 
for the Service Rating scores and resignation rates of cadets and graduates - \ 
: who had attended a preparatory school is indicated, 
sed, a ce. Sere BB cts Osa a See eee 
° ‘ ‘ss ry . a 7 pe 
ee 
‘ a & . 
‘ s ‘ “is ¢ 
YY ry ; , F < 
; 7 f 
’ Y 
1 . \ = 


a deat 
. . : 
N ar 
. } r 
. » 
» . ~ é . ‘  cpnemeamememmnattel 
‘ ° : 
. . 
“ . 
. 
. ‘ 
' cn 6 . : « pi 
‘ ° ‘ * 
-” . . 
. ' * . A ‘ 
; ‘ « 
a) ” r 
: ' & ; . 
e Pe 
a e A ey .3 
: j a : i NL de ‘ 
' e ‘ } . 7 
‘ ‘ as \ > ) a 
; r 
: + 7 ‘ 
t 
. ° 4 
« ’ ’ ‘ iy 
* e 
! = ‘ 
J - 
. a ° 
X . . , : 
7, 
* v e 
XN . ’ wy 
. ; , Z 
' ‘,0 , : a 
7] | ‘ 4 * 
‘ a 
. a Ty . 
ne ba ¢ 7 * * 
. 
: e. ; ; 7 ‘ 
: o% 4 : 7 ‘ . - ; se 
m3 : ? 
s 
4 | a ® “ 
- 8 
: : a 
’ «! » t % 
: - 
e = ‘ 
4 a . ' ‘ < - 
a 


a oes : 
4 , ny 


7 SPECIAL TEST ohe PARATION, brs EFFECT ON COLLEGE BOARD SCORES: AND THE . 
us RELATIONSHID OF EFFECTED SCORES TO SUBSEQUENT COLLEGE PERE en uo 
t Introduct ion od . _ 
_ ; s . a 
Stuldtes atl both tha United States Air Force. Ac adony nnd ethe Unitetl States 
Military: Ac Ademy have shown thet ¢h@ actual ecollopea parformagee ot amany cadets 
who had taken ah oxtra year’ ot preparatfon in prep se ne Ono= val . 
curriculums for stude its seeking col bege admiss tonyw wa far be dow what” was | 


ee fee 


OU from their scores” on -one DON | S MOT? of the dt Lega: Board’ eee. “Such ° 


a re ee ie er et ne ee cnet sae 


va 


pene thoy attended schools. whose erie for-existence—is te enable --——— 


the applicant" to gain admission to college. It ‘ts to be expectpd that f 
emphasis would be placed on the gontent of, those’ tests commonly used by the 
colleges as aids tn determining the qualifications of their applicahts Tn 
Tact, in some of the schools in this? study, the March College Board examine 
tions tonstitute the final lexams, while in others, a large majoritylof the 
students feave the school after the March examinations even though the school 
‘has a curriculum continuing to May by way of additional preparation for 
college work, . p) ; ; : 
7 : 
Seve rar Studies on the effect of practice on College Board test scores J # 


have been carried out at ETS or under the auspices of the College Boards, #1) x 
All of them were carried out on the ane tests, and all of them were concerned y 
with the’ effect: of practice as stich: -&., one or two hours of practice per 

week ove x peuiods of - time varying Bk six weeks to six months, Practice, is 
here tp dé findd 1 as h concentrated and systematic study of test items comparable 
to those found in the Cellege Board tests or material prepared in the form of 
test’ i toms as they are presented in. the College Board tests, the rationale 

for such an approach being that the student not only learns the matertal but 
also gains in test-taking ability.’ No sfgnificant improvement in test scores ” . 
due to PRRCUICE. was found by any of the studies, - 


; “there is gome question As to just what gix months of full-time exposure 
to* COUPSe content Utrat is direca ly ae. to the verbal and mathematics 
“Callege Board tests (both Aptitude and Achievement) should be ealled, It 
could well be considerpd an extra secondary school year as qaresult of which 
a normal year's:growth would be expected. | On the other hand,. it could be 
considered as simply an: intensive practice period, ¢ 4 . , 


. . 
* 
4 N . . 


If the geores obtained on the College Bagrd tests after attendance ‘at. 
a prep School were trud reflections of the qndividual’ s ability. to perform 
college work "-- or at least as true as such scores ane for secondary school ‘ 


° 
’ 


tf 


od . 
ae : ‘ 
ie ae * : a) 
. oo. 
. 
. 


thts invest ipat Lon Was supported ino part by the Col lege Fntranee Examination : 


Bs _ 3 Board both through & research tee Jand by RrOWTSNCKG test s and, tes k scdor ing 
1 # . 
. ae eae e Cee * 
s sy . ’ f 4 =. 
‘ - . ‘ 
e , ) 1 | a. * _ 4% 
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' awentors -- one would expect such scores to be as valid for predicting the 
coltege 4 performance of the former as for the latter, The test of the yalidity: rn 
' ‘of such scores then must consist m the acouracy With which they predict ‘y ~ 
eg! lege. performare. —~ ee As ; 4. 
. " a ‘ : : Knew 
ra Ns : If upon subsequent validation, those who attended coaching schools : 
‘ perform far below what whs predicted-From their test scores, there are two 
: cone lusions that can be ‘drawn: (a) that the prep schools are nothing but ° 7 
intensive practice periods, inflating test scores far above tho predicted 7 
st bsequent actdal college performance of the student; (the student is made ‘ 
i} 2 envyeraetoyor): ‘or (b) that the prep schools attract the underachievers: . : 
. thdt their ffnal scores are true reflect ions of their ability but that they _ _ ae 
Me ‘do net perform up tg their ability due to ‘any or all the reasons that are : we 
usually offered for ‘underachievement, However, whether conclusion (a) or (b) ° ai 
* .is the correct one to be drawn is a moot point since in either case the SCOIUS - 
deo not reflect how 4he student can be expected to perform in college, The : 
colleges recognize that they will always admit some underaghievers by de Cin- : 
. ition. But few colleges will admit a known underach kever over an unknown 
| ¢. underachiever, all other things being equal. 
The Sample _ . : 
7) i : . 
ee Eleven prep schools participated in the study. They are: . a : ‘out 
te l. The Boyden School; San Diego, California 7 ' ; es ; 
2. Braden's; Cornwall, New York : ; < | . 3 ‘ 
‘ | i 
: 3.06 Bullis School; Silver Spring, eMfry Land - 3 ' ‘ 
— 4. “Columbian Preparatory School; Washingtan, D.C. : é ” 
. eo . ad <= ; 7 a 
5, Millard School; Bandon, Oregon’ : ae 
ry - 8 
. 6. Northwestern Prep; Minneapolis,, Minnesota 7 ‘. ‘ ~ " 
N« ‘a . ; t 4 
7. Sullivan School; Washington, D.C, . ; 3 
= a. ‘. . ' ‘ 
° 8... U.S: Air Force Preparatory School, Colorado Springs, Colorado a 
a 9. U.S. Military Academy Preparatory Schvol; Fort Belvoir, Virginia 2 5 . 
. . : ; ‘ - ae 4% 
° 16, _ U.S. Naval Academy’ Preparatory School; Bainbridge, Mary Land *. > 
¢ lt, University School; Pittsburgh, Pennsylvania a a (' 
* ce _ ‘. *.) wf t 
“— There was a total of 1268 students in attendance at the ecleven schools, ° =< i 
The .number in aan Beno” PAREN: special college entrance curriculums EAMES’ : 
= “trom 29° ‘to 285.- = sear acca? , ° = nia ae 


A] 
a e @ 
{- sy, ; aj 
‘ From reports of supervisors at the test centers, the satiple was reduced 
asa followa: 


re a 


« 


Pa n. Four f@o Lo/ cases wore drépped: from the Boyden School, 
> a 5 4 7 
b. The entire University School was dropped for the following reasons: 
. * e : 
(rt) Over 60% of the students ag fomale -- a fact of which We were 


hot aware‘at the time of contact --) and J 


. . ms o\ 
(2) ,The school was not of Lhe- sane type as the others, It is 1 

four-year accredited prep schvol, although a large portion of the student 

body consiats of students ‘who lacked a sufficiont number of credits to oo: 


gradyato from the high school attended previously, There is no special 
attempt ‘to prepare the tnrdividual for the College Board tests. The school 


~ ts unique in that each studeht is tutored privately cach day in each subject 


‘for one-half hour. There is no post-graduate program as such, 


é . 


Bullis and Boyden are also four-year accredited’ secondary schools, but 
they have a special post-graduate program. for boys who Have completad their 
secondary school work atfd are seeking admission to a aolleffe. All the, other 
schools in the sample are non-accredited prep schools devoted exclusively to 
preparing high school graduates for admission Lo col lege. 


After the above eliminations, the total number of skugents tested in 
September 1962 was 1206, It should be noted. that of the original 1206, not 
ali took the entire battery at any one of. the National Administrations of 
CERB Vests, and many aid nok take any of thesexaminations in March.” AU. 


Iinay of the actual number of tests results available from each of the 
5 ‘test. administrations %s presented in Table 1, . ; sae 
So —— * ~ + ns A ” 
‘7 \ ‘ 
° ~~ ' . e . 
; . ? ‘a oy 
. \ NQ ‘ 
5 . = - ~ a e ‘4 
oe . Y eon ry 
* ; ‘ . : rd a 4 
se : 
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‘ e 
{ 1 ‘ ‘ 
@> ; , ww = * ¥ 
r] “\ . = 
¢ eS - ¢ 4 
p Table 1 * 4 
. i , . m : : a : 
SNUMBER OF TEST SCORES AVALLABLE FROM FACH OF FOUR ADMINISTRATIONS ; Thy Fe 
THE EXPERIMENTAL ADMINISTRATION IN SEPTEMBER, 1962, AND THREE . rd 
NATIONAL ADMINISTRATIONS, DECEMBER, 1962, JANUARY. AND MARCH, 1963. pie rteedy. 
. ; ‘ e ww WAG 
. > September Decembor Januyry March 5 
‘ So cee ge eee ee ee ee og * 
AS Total Number of Students 1206 + 435 639 717 
B. Total Number of Test : & . ‘ 
= P : : 
Scores on: . ae ? ‘ a ss 
pr gers Bee acs aes FS sai URE oh Ob nb de G we a Ase dae Gee: weekeeelowdied cacitle caters ile eee ees eas Ed Sens 
fg 7 Ge inet 
SAT-V. - 1202 434 627 '714 . 
SAT~M . 1204 435 — 628° 715 
ag e - ‘ Pe id 2 } 
KC - % 1203 290 557 “ 649 
; : * . 2 
IM 1201 280 | 533 610 ' 
d . * een ey 
~ AM ie = 903 185” 268 25) 
% va . 
: : . ‘ene 
Rano: 7 " . 
Y . . ¢ ad 
; Procedure ® 
3 : % : 
The study was initiated by the administration of a full battery of ‘ 
College Board tests (SAT~V, SAT- Mw Beate Composition, Intermediate “Mathe- 
"matics and Advanoed Mathemat ics)® ‘each school during the first week of 
' sehool. The times of the ieee were sufficiently varied to enabld two 
teams from West Point to supervise the administmation in nine of the‘fsehoo ls, i. 
An Air Force Officer\ from the Air Force Academy who had exper fence in Lhe —— 
. College Board testing centers supervised the testing at Millard, and a Colleg@m 
. Board representative from Los Angeles supervised the administration at Boyden ’ ‘ 
in San Diego. i ' 
GO - ‘ 
a For the study of -the effect of special preparation on College Board 
test seores, the March administration.of the ‘CEEB tests was selected as the » 
e cone from whicl gains in test scores were to be determined, primarily bécause i 
e 
: a! ‘1 
: . ’ v e : . _ roe 
‘i ‘ 7 F . . aaa : . 
The Advanced «Mathemattes (est was not administered to students at the ULS, ' 
Naval Academy Prep Sehoolt at the request of their administration, t 
- ry : ¥ 
t+ “ . ‘ 
t 7 . ~ 
(. 1d wey 


a 


a ae 


. _ = ‘i “. 


it wha tho administ&atign toward whioh the greator number of the atudonts 


in the prep sghools were aiming: and hence, the one toward wifich the curricu- 7 
lums of the majority of the prep schools were gencrally geared. However, in ¢ 


nll of the, prep schools, there were students who-wore also, if not. primarily, 
interested in the January administrations, Such was the caso: with those 
students who had Competitive? nominations to a Service Academy, Bince the 
number of young men seeking entrance to the académies via th compet ifive . 2 
catogor tes far exceeds the number of vacancies (as. many as 6DO applicants for 
30 vacancfes), ‘the academies are not concerned about being unable to: fill the 
vacancies with highly qualified you mon, That, plus the, fact that it is 
administratively destrable to spread the work of admissions out over as large 
a time span as ts practical, has prompted the academies ‘to require applicants 


for competitive veeanetes te subltit the required entranece- exantination—seores-- 


ag carly as January. Prep schools having Students with conpeyitive nomina-~ 
tions adjust their curriculums to’ provide them with the maxinum preparation 
for the earlier administrations of the CEEB tests. 


roo Mice a considerable number of students from the prep schools sonter 


the acXtdemies via the competitive categories, the second ‘part of this report, 


name ly the relationship of final CEEB test scores: to college performance , 
utilizes either the January or the March scores, whichever are available, 
Further, the higher of the two scares (if both are available)’ oy any, one test 
is used, This {4s common pract jce in fil the academics , "and is eapplied to all 


applicants. . A GA 
s . ra 
Since many sudente in the prep schools took the CE tests more than 
omee, a préliminary test. of the’ effect “ot multiple-test taking was hecessary 


Pade | 
-to determine whether the March ta@st results for such students could be “safe ly 
combined with those of students who took only thé March exams, Analyses of 
variance and cevar Lance (controlled for differenced¥in September scores)’ were 


_ Carried out on samples selected from those. prep. schools in which ‘a sufficient 


_variety of test-taking combinations were: available. a 


~ 


It was anticipated that hese would be signiticant differences amang ‘the 
JA elite Jaina agg to their* average CEEB test scores from the March 
admingatration or the determination of which, analyses of variance were 
~ 2 e 
. . 
o ' ee ee ee eet, ae ee : y 
3From 12 to 2 percent of cach entering class in the service academies is 
composed . of young men Y ag do not have Congressigqhal appointments, The 
competitive categories have been established’ by Congress to assist sons of 
- military fathers, of deceased velerans and young wen in the military service 
to‘enter the acadeny, A Te a a 
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§ ‘ 7 = He : h 
carried out on both the September and Mareh se ores. Analyses of covariance = 
were giso carried ot in which March scores were adjusted for differances fn, oe 
input’ as measured by the September stores. . , fie 
, ‘ \~ “3 5 ie PY fte 
In addition, a certain amount of background data was obta{ned from ; - he: 
» availabke records. . They included: a 
. . é . « 
. a, Wumber of secondary schools attended, 4 : ' 
= b. Number of ‘mathematics cotrses taken prior to entering the prep : 
school, , . : =. * vg ; : , 
4% e. ‘Number of English courses taken prior tor entering the prep school. 
ad d, The most recent test - score of intellectual development and/or apti- 
e, Secondary school standing. . ~ 
a . ad 


spe o . 2 ~ . 


Since alk the background data Was not available on all students who took the 


., CERB tests in Mareh and henee would have necessitated a cuns iderab lo redue- oo 
tion in the sizes of samples in the various prep schools, the relative effect : r» 
of the background Variables on ‘average Mareh scores was evaluated by computing, os . ; 

‘i “a multiple wathin-groups correlatign; i.e.,, by determining whether valid "March . 7 | 
test seore within-groups variance was predictable over and above that which i i Saati 
was predic table from the eptember test score se variance. 4 ane 

: wil, . Pa : wn! 
Lists of text books -and course schedules were also obtained. for each ~ | 4 - : 
prep school in the evant that (a) differenees in CEEB test-score ‘increases ee ee . 
were sufficiently consistent across tests ‘of similar content anorng the’ prep. ., ie _ oo 
scHfools; g.g., SAT-M, Intermediate Mathematics, find Advanced Mathematics, , ’ ee: 
and ,(b) the number of groups of prepsschools showing Like increases in test eas | ° 
scates as a result of analyses of variance and covariance were small -- no i ¢ is .- 

: mbre than three and preferably two. If both of the above conditions were to = va paar : 
occur, sp. careful examination of textg and sehedules might well reveal differ- ie Ca. i 
ences “A such patterfis consistent with the differences in score .{ncreases., - : eS " 

Because over half of the prep schools had indicated that it> was their oe os eS 

; policy to devote a few days to the administration and simultancous -study of ne ° ‘ igi” 

» dummy examinations just prior to the March. exams, it -had heen planned to 4 : 4 in 
. carny out a second experimental administration of the entire test battery. © ae ; wo 
just prior to the beginning of the “pure” practice period, As itTNurned out, de es 
only one ef the schools devoted a sufficient amount of time to practice to: ie ae ‘ns & 
make a second administration of the test battery worthwhilé This, second ; 2 he g 
adminis tration was of no consequence to the main purpose of “Ane study since Ve es : 
; — . eu . 
Iseg ‘McNemar, Quinn, | Ps chological Statis stics, second edition, pe 354, | be 2 — a Es 
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Pre yp rac tice period mast ho —gons ido reat as rie of: “the citer ai Can ant ee ee 
gahool, On) the other hagul ; it was of, Sparc yyy Intorogt: ‘to the yep: cane as 
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sty wdent, eo : 28 | mg ae a - a - x as 
i ER ; e : ty: ae . oe, ‘ ‘ mye 
Hence yp SOC stud administration of LAS tone uae ley wh: syauiiitiall: ‘oul eee 
Columban, two wooks prior to the Nat inal Marsh Adprin deta att on, oghinrediscie, 
The, ‘results: ot th " wlady are reported an Append tye B As x matte rset, kG adein ie / 
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Tip secon phase oft. the sludy deals wyth Ass eaetiah: in ef ainiahee "a4 a 
stigichts “At tend ing Serv. ce ag ALO MLO tiring’ h@gty: first year | An collars age 
measured by. their eiyt- “yor performaned with: wAARpeoTt.0. ‘the Uv gato to 
“Which their’ énd4o0F-yeat | MET ormance ‘ts cone | Tatdnhewy thee be Ge sa per forwance : 

-hac their final College Board stores beon gx ‘yatta - prnd.le bond ‘gs. tniey | ‘are for” 
their college ¢ labses | : hode, The expdol Ba : perf adinned, fis Uibgit } ROW ‘anf 
nown corretat Siok. ‘Bed weoin, Lhe Cotlege® Bogra ae 
tests and “final lass. stands ie, ahd otk: “Chi square. beg: of gobduess., “iy de 
earefed out botween “the ‘expotted and the, te tia} 1 lasy” “a and bry int a acl) Pena s 
- By adopt it a re tatively. low corr elation Ege fT tei eng: ‘aged bytdétermtudng ic ww 
expected. standings separate ly’ -for each acatomy.,# the - jSepargto- ‘aga a sae 
sanples could be combined tnto a Single. SAMPLE, z “hs ¢ 
' , *s “” - “les : i = 7 a ii . 

‘Subsequent to thé skeporal, s study wr tng relationship. ‘Sebepon opegeted > 
college performance Gand actual ‘cobbege pey formance, for: which: the ent ive: 
Sample was tised, ‘the oe woe, eapr ied out for tho 5 LUdouits rom. 
the separate prep schoots as far * Tt ‘was practignble tpravidod there | : 
wore a sufficient. number from a, given hrep ‘school t hadi iy. tendtd ay servitte ~ 
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. Coincigent w rth the stud of pert ormanie of prep scheo} studepts at 


stinkdnts Attendang thé ‘aeadem ies wea'd - ‘representative of the entire, prep. - ; 
schoot sample with respect t he average: increase in Sepres from Sejitelnbe r, a tay , 
to: ‘Make, Sinee previous’ a fe carried oul "Ate he separ ‘ate. Academics had _ r 
whit inet only those: an ettendahce at ‘the: academies’, there Way gome «question of “ | ae 
an ta we the pr: the Academy samples were ru preseritat ivé or typical, at vthe prep. 5 
“school graduates average inewease in CE BB Lest scores a? - i nae ty 
be wa ° 2 . ‘@ . =. es . ee awe # _— eo 
The quest tons, and, the. ordey’ fn which ghey are, tre ated in’ “this. roport are : oe a 
. lt : 4 ‘be 7 HG ; - ; ¢ a ae 
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: os ding, ° a . ' 
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2 Xv, oe le 2 f m 4 
t \ ; ‘ os ’ ue e : 
4 . . oe Pp, Analys|s Of the Data _ ~ oh ; , ; . ; 
; > >» ) 7 a en 7. 
» - A, The Effect of Special Prep Schoo | Gurificutums aa CE KB Test Scoreg _ 
. uate cai ae ee sea Rae aie 
nae A pre Liminary at teat fon of Sits eftéct-.of mutt ‘pie: test Caletine on . rete 
” -fingt scores. was carrted out (Appendix A} to determine whe ther students : . Peacoat 
taking the tests ‘ttn December “and/or January as well as in March could .be vO, 
comb tned with those who took only the March examinations.  The're Was no. + ac a 
: evidehce to indicate -that they could nat be combined, - - ace 7” 
‘ : : P : - = ; ‘ . 
Pa Before evaluating the overall cha re in scores as a result of exposure ; a ee ‘ 
to coaching school curriculums, it was first necessary to determine whether ™ 
there were any differences in score changes attributable to differences in ~~ he _ 
the school curriouluas, Analyses of variance and co-varian® (controlled ; eer 
far differences in input) were carried out on all five tests Usink the March— pence 
° scores as the criterion, : ; ; . ‘ ; . 
Significant dif ferences*were found nnong the schools with respect to a. 
both input as measured by both initial (September) scores and final (March) ; 
scores. Analyses of covar iante were then carried out in which March scores | L 
Were adjusted for differences in initial (September) scores Although the Smtpre ms - 
F-va lues were Mani when finali scores were controlled for “@ifexences in be a6, 
a sign cant differences remained. 5 , x a 
‘ e Pcgmmeeramimsyn - 
The results of the analyses are summarized below, \ ne 
? - 
os — epee we | ee... 
“Multiple within-group correlations were also computed using all stadents . 
for whom complete data was available; i.e., for whom we not onl¥7had Septem- _—— 
ber and March scores but also (a) number of secondary schools attended; (b) pup 
number of prior mathematics courses; (c) number of prior English courses; ¥ 
(1) test scorey of intellectual development; and (e) secondary school stand- ; 
ing. The maximum number of students was 448, Because of the considerable i ; 
. reduction in the N (from 715 to 448),° the application of the results would 7 
as have ,been extremely limiting for the entire sttdy had “the multiple within- “7 


group correlation been significantly increased by the addition of one or 
* more’ background variables. “As it turned out, the within-group correlation 
. between September and. March SAT-V scores was raised from .809 to .810 by ’ 
the addition of secondary school standing; from .826 to .827 for SAT=M; from 
.650 to .660 for Engltsh Composition; and from .740 to .750 for Intermediate 


Mathematics. The results do not justify the introduction of ddditionat ‘ aL 
controb with the Wpe of further reducing obtained differences among the. . ; . 
schools. For additional details, see Appendix C, . 
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‘ SUMMARY ‘OF F-VALURS OBTATNED FROM ANALYSES OF ae oe AND COVARIANCE 
OF CREB TEST SCORES FROM TEN PREP SCHOOLS ~ . 
~ bs ry , . 
m ‘ 1. . Ae 1 
SAT+V SAT-M" ¥ | 
a jSeptember March» September March 
\ 7 . . 
Analyses of Variance. 15.4Q . WO.41 27.92 25.19 =. 
' Anhlyses of Covar tance 9.624 3.361 
hae, a © R v 
“* -€nglish Composition? Tht. Math® Adv. Math?” 
Sepg. | Mareh Sept. March .| Sept. Maréh 
« - 8 . : . : - 
Analyses of Variance + 16,116 19, 289° 19,24 19.44 5.819 13,688 
Analyses of Covariance : 9.259 6.904 7.972 — 
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Aaya Lee of 1.90 ‘Significant at .05 level, and 2. 


level. 
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3r-values of 2.05 signtficant at .05 level, and 2.73 


‘level: 


‘t 


aA. 


? 


 gignificant at .O1 


significant at .O1 


significant at .Ol 


* 


a 


Adjusted March means (3) were then computed® and Tukey's” (2) procedure 


for comparing individual means was applied. 
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othe formula for computing adjusted March scores is’ My-b, 


by= fhe within-grow correlation. 
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It shgtuld be noted that the procedure -out Lined calls for equal N's in each | 


of the subgroups, Lacking equal N's, the average N was used as the best 
available approximation, 


The results of the application 
of Tukey’s procedure ‘are presented in Tabld 3. : : 
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AVERAGE COLLEGE BOARD .TEST SCORES {MARCH 1963) ADJUSTED 'YOR DIFFERENCES IN 


, .  INPU (SEPTEMBER SCORES)’ FOR STUDENTS PROM. TEN PREP scHooLs8 
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8Blocks of schools are significantly different from one anothes. There are 7 
ho significant differences among schools within blocks. ; _ 
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me 9Not enowgh cases in school D to include in analysis. ; _ 
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Pyne seplember and March average s¢ Dren, fopethemwt tit aver afte SCOPE — : As 
inereases, ure prosented in Tubles 4, Phreweh 4, for Rroups as ‘dort ined in Tale .roofe Po 
: ‘3. , <a A e. ‘e 
ae - he v 
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ee ag ee . - 
, Table 4 ° * 
SUMMARY OF DIFFERENGES BETWEEN SEPTEMBER AND MARCH SCORES 
yo : ON SAT- VERBAL BY GROYPS , * 
- , i 4 ~ 
ot : . : bw , $ 
Se plembe r March | Dif ference = a ge, 
n M : SD M SD . (M-S) a enn = Aa 
woe. ro - a‘ ; ee 
Group lL (C,), 450 Ok 62798 177 one 
(N- 83) 7 ; ’ 
: - 4. t 
Group 2. (A,B,E, 475 BB ‘83L BA 456 . 

FG, (600) | : | . | ; mes 
“Group 3 (D) 45664, 50a 106 147 a 
2 5) : , os 

Group 4 (1) : 437 = 78 BY ATR 72 ' 135 ed 

(Ns.26 ) . ; 

‘ “B Table S87 
a SUMMARY OF DIFFE RE NCES BETWEEN SEPPEMBER AND MARCH SCORES 
* ON SAT-MA' PHEMATICAL BY GROUPS a . _ 
° x ‘Septdmber March Difference P : 
M + SD M SD (M-S) aoe 
v - . "ok 
Group | (C,F,G,J) 570 0.8" , , 653 BG +83 : 
(N-232) J wee : ‘ 
Group 2 (A,B,E)~s 520) 3 598 85 *.78 
& t 
(N-405) oe : 
Group 30D, ow, 479 96 551 103 +72 ° ! 
(N= 78) 
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é i } . . : Table 6 : _ 4 z 
yt SUMMARY | OF DIFFERENCES BE TWEEN) SEPTE Mle RAND. MARCH: SCORES . 4 ag rr : 
3 os @ ON ENGLISH -Conpos tT TON BY GROUPS a * : ele é 
vo . t x . 7 \ . afte 
: . Septembe rv ra March \ Difference ‘ 
ee. 8. MV, sD MI So (M-S) : _ 
7 . . 7 - ’ . - : t i ; { \ 
Group 1. (C,E,G,J) 472 —, BL |. 568 BG 495 ae 
(N 236 ; | | 7 oe r ; 
Group 2 (A,F) 43g | 84 ‘518 900. 7B ae 
N=154 be 8 . : i on 4 ‘ = Ss oars _ 
rn ( ) = 4 5 2 Bay 
Group 3 (BH; 1) A3B : 73 490 85 132 ae 
. (N=126). ; . ro. ; 
™ ; toy 6 7 : 
Group 4 (D) 386 — 372 0 = ~-- | 
e ; : . . ; : wey 
| : . Table 7 ; . ss ; . 
8 « . = ' ‘ * Ppproesemeametames 
ae OF‘ DLEFERE NCES BETWEEN SEPPFEMBER AND MARCH SCORES, “oe 
a .  - ON PNTEaE DIATE MATHEMATICS BY GROUPS - vl 
' a ‘ ' 
‘ . September . March e . Difference ,  & 
; % _M sD M SD (M-s) - Pe 
& ae we 2a ae 
~ , . ; i. “\) , 4 
Group lL (F,G,.J) 537 81. 686. 78 - £149 : a 
(N=187) : : ' * p 
; eg meen eanneelll 
0 Group 2 (A,B,C,B) — 84 ty G15 89 1131 £ : 
‘(N36 i> . 
ry l . ( 
Groap 3 (ib): 441 78 - 554, 112 +112 ; ; 
: (N=37) ‘ ‘ 4 
Group 4 (1) , «= £53 105 - Q37 140 +t 83 : | : i 
(N=25) tg ‘ “ : 
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: ‘SUMMARY OF DIFFERENCES BETWEEN SEPTEMBER AND MARCH SCORES ( : 
i ; . ‘ ON ADVANCED MATHEMATICS "BY GROUPS , ’. <— 
x ss he “haere 
a : _oepteimnbe r - ‘March Dif fs6rence PBT A 
— ’ mM’ SD M - SD (M-S) ‘ aaa tt 
{ 
9. Group - (G,F) G22 By 666° 67 14d 
’ (N: 127) . : . 
Group 4 (A,B,C,H,J) 167 77 O84 O7 4117 te 
CN: 102) “ : a. 
" . eer Cees 
Group 3 (1) > ‘ 448 103 525 94 = TG - 
(N 22) , *, 
: a ge 
nN * tee te Vv : fh 
p a 
Uhuervial ion alone is sulfieient’ ¢ o deduce that al lL increases * ine scores 
from September to March are signif icant, particu lar ly when one cansiders that ‘ 
the correlations between Sept. ember and .March scores are as follows: Lo : i 
. x - ° x : , : ts 
SAT-V =. 8k ne 
SAT-M. - $83 ‘- 
os EE 
. KC ~ 69 ; : ; 
. i) 
. IM =, . 716 a 
AMJ + -  .74 
fe . ‘ « } 
1B, Rela it vonship Between Col ere Board 'Sceres. and fed -} reshman- Year ; t 
College Perfor maANce . ‘ . } TBs ; 
wc ne ; 7 
. : ” 1 4 . . yr geet 
: 1, Prep School Students Attdnding Service Academies- y. = p 
™ aw : : ; 
Of thettotal original sample (1206), 405 entered. service ‘academies in * ; 
September, 1963, 18 of whom Were separated for acudemic reasons and 62 of \ : 
whom resigned by the end of the first academic year. The summaries by : i : 
e : , : « a : . 
' Service Academies are as follows: | : ; \. 
. : NE Cee eet ee St ee oe . 4 i 
LOWnen testing far the s 1 roel icant “difference between corre lato means, the ieee. 
standard error of the differences (by ee the Mean difference is decided) ’ 
ig reduced as the poree ne ion is increased: ; ne vo} 
Pe | ; 
SEaie¢e (corr. means)” . a7 ie ee : . . 
: a ag ee ae an a r ; 
S a = ; ‘oO + “5 ¥ re 7. r 
. Baier (uncorr. means ) v6, 2 * — ; 
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. 7 , a ae | : as . . v . : 
fn 4 i \ - ‘ “ : j . a : _ . - 
n hntered Active nt) Bid Academtcalty © Resigned ly ; : 4 : 
"4 * . of First vote Defic tout i. 9 ; a . a 
s ry : : , ‘ é - ; = , ‘ . 3 . -/ et a. t in ‘ 
USAFA 133 . 1ta a 2 Ye AS ye pO WEDR 
. : ii . * ; 5 <i ay . ° oa . ed aes: 
t . 7 ae of 4, . et tee * 
USCGA ar l 5 0 O-e l 
a, = : ; : ¢ . ; F ‘ _ 
USMA <. “We 58 - 4 es a 
. . € . - 
| : ‘) \ o- 
USMMA. 22 , ~ * 19 0 3 : ‘ 
’ : =y : , 2 
USNA 177 134 13 : ' 30 
am Sa a ; —_ ; ; ry 
=a : : ome a : ‘ r . ~~ 82! a 
Totals _ 405 325 ' 18 - 62 . , 
One of the questions not answered by previous in-house studies at 
* ag 
both the Air Force and Military Academies was whether their prep schéol ‘ 
samples were truly representative of the prep school population with respect 
to the average increase in scores, It is apphrent from Table 9 that con- 
siderable selectivity was exerejsed by the academies in their admissions . 
policies. : . , 7 —_——~- 
‘ 5 ‘ _ 9 ee 
' SEPTEMBER AND MARCH COLLEGES BOARD SCORES OF THOSE WHO ENTERED A 
: SERVICE ACADEMY VS. ORIGINAL SAMPLE : ' 
fi _ Service Academies Total Sample 
N - September March N September ~~. March 
OM sD” M SD 0 M SD - M SD, Hike pds & Be: Ges 
( . . . > ; rr 
' SAT=¥ 314 9970S BB5573- GH | 714 / 471) 89 2B BS | came 
, Fe : : . . t 
SAT-M - 314 580 BOssHT G1 | 715.) 5320C«OD SLE O94 
. BC 309-494. 68:—«CBD.—s7W_| SAD 5B OBR 540 93 + 
IM -~ 288 536 75 676. 71 610 497 89 629 100 : 
. 7 
AM \4l 526 + 79 658 75 251 494 85 620 96 
! ‘ 


Whothor these poligtes favored Che individuals whose scords were boosted 
higher than the average ineremont was de tormined by computing difference 
scores for two YrOUDS ; (hose who entered the academy and those who did not, 

. Tho average incroments for the “lwo groups are presented in Table 10, 
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obtained on a given test when assessing) the qualifications for all applicants, 
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SUMMARY OF: INCREMENTS FROM ‘SEPTEMBER * TO MARCH SCORES FOR ios: wn . 
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WitO ENTERED SERVICE ACADEMIES AND THOSE WHO BSD NOT 
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Caddts , ~ poncenteds 
Mo SB NOM SD + 
56.86 - el | “400 | 58.39  --! 
716.60 =} aor 80.74 ~~ | 
99.197 61.87 | 340 -_-40,99 |, 54.74 
? ; j 
139.85 61.79 322 126,42 68.44 
7 Y 
14 61.14 110. 121.37 «69.50 


*Significant at the .05 level.* 
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\Wwas not computed. 
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Significant at the .OV level’ 
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» t-values 
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The increments on bath Eng kpsh Composition’and Intermediatdé Mathematics 
were significantly higher for cadets than non-cadets. It 
however, that it is customary for the academies to'use the highest score 


In addition, s 
be submitted, 


“the re lative 


should be noted, 


ince either the Intermediate or Advanced Mathematics score may 
the higher of the two is used in computing the average Math 
Achievement test score. pence, for the purpose of *this phase of the study, 


positions: of “prep school” endets are not out 


relative positions of "non- prep school" cadets. 
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‘quite different for the various academtes (Table ‘11). 
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Tre average College Board scores for the classes:‘entering in 1963 were ° 
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AVERAGE COLLEGE BOARD SCORES OF CIASSES . ENTERING THE SERVICE 
‘ AES IN JULY, 1963 : 
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p tc : ' : . e 
SAT~V SAT=M EC I or. AM 
USAFA ; 590 678: 590, | 660 
‘ 1 { * ‘ . 

USCGA ising Tale ~ ah = 
USMA 868 644° 556 , 827 
: 2 . r oe . ra . ¥ stg . : 

USMMA® 549 . ae 52h, 591 
USNA“ - 591 "663 583 645 

“ : = Hf 
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: a pal mas ae . 
LUSCGA “id not use the CEEB examinattons .as an entrance 
, / . requirement. 
xX! e : ‘ 
. Manual of Freshman Class 


Entrance -Examination Boar 


Iyofiles, 1964 EEO ee 
1964 : 
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’ / 
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Because of the variations in mean scores for the separate academia, it 
was necessary to convert the. scores to a common standard, Although it would 
have been desirable to use a standard score conversion, the $tandard devia- 
tions for three of the acadenieS were not available. An adequate conversion 
was effected by determining the fifth of each score distribution in which 
individual scores were located, © The distributions by fifths on each test 
were approximated fram fhe 50-point distributions reported im the Manual of 


Freshman Cottege Prdéfites, 1964 Fdition (Table [I in Appendix D), The obtain- 


ed distributions are presented in Table 12, (See Table IT in Appendix D for 
separate service academy distribut ions, ) 
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; Table 12 ; 
s . . ; : ‘ d 
; coset COLLEGE ‘BOARD EXAMINATION DISTRIBUTIONS OF PREP SCHOOL STUDENTS pee ye 
WITHIN SERVICE ACADEMY DISTRIBUTIONS’ ‘ ; paps. 
<3 0 . { ee eae . 
‘ Distribution . . Ehtrance Examinat fons . " 
, SAT-Vic SAT-M ‘EC I or AM 
° Top fifth . 51 67 95 138 
2nd fifth - 84 \ 61 74° 2 ee 
’ . ; 7 ? oe qi 
Bed fifth - 66 65 73 $7 : a 
: o la we ae 
4th fifth 83° 65 A5 31 2 
Sth fifth 62 58 280° 17 
ed —. 
Totals! 316 = 236 315 315 
. » 
. Ihe highest score for any of three neestois National CEEB administra- ee 


tions (December, January, or March) was selected. for the distributions, « 


are due to obtaining scores from either the January or March CEEB 
administrati«s. 


. 


L aaa eae aad . . 

From the above distributions, the expected sans ete hae computed °~ ' 
using the probability tables developed by Richard P, TT: scott, The pre-> ears 
dicted distributions were developed using the table foranr of .35 Between : - 
the independent and dependent variable (End-of-Freghman-Yeart Class Standing) 

oe even though the actual correlations between the converted class’ Stanting!4 : en 

and the five College Board scores were all above .40 (Table 13). (Sep , mos 
Appendix E for a further description of the procedures followed, )- a = 


ee Se * bia Mies ’ fe > (- 
fr. . ’ 
® ; 


ll gee Statistical pecans and The tr Mathematica Bases,’ peters and Van 


his, McGrawefill Book Co., 1940, pp. 508-510, _ = 


12 aa ‘ ; Pe 
, The, foFmula used or sonventing class standing in the separaté academies 


WwW 
(2 (actual standing) - t 
B00 - _ (2 (class size)) ay a eee o 
: ° | f 
, ." b. 


18 : | 


~ The’ equal N's” (one cadet was not required to take the achievement test) A 


a ‘ . - / Pi . > - 
; oO Table dd : 
CORRELATIONS BETWEEN END )_ObFRESPRTAN YEAR CLASS STANDING AT THE Nene 
SERVICE ACADE MIES AND THE COLLEGE “BOARD TESTS SCORES OBTAINED AT THE ' Wise ten: 
JANUARY AND MARCH ADMINISTRAT LONS ‘ Pe: vA 
MARCH a JANUARY « 
N. r . N Y t 
"  SAT-V : 242 £431 224 4201 
a ie 
SAT-M 242 3424 224, 436 in 
: aa t ‘ . 7 ’ cea hs Vind oo. 
EC - 240 . 382 228' 430 Sai 
IM 223 £443 . 222 418 | 
. oe 7 
AM 121 ‘ 438 138 : 468 
S a : [ 
The predicted (expected) distributions together with the actual distri- : 
butions are presented in Table 14, : othe * 
A ° . os 
Ere ‘ e mmevemnsoens 
$ Table 14 | c 
| he 
PREDICTED (E) AND OBTAINED (OX_DISTRIBUTIONS OF FRESHMAN CLASS STANDING 
oy ‘ ~ FOR PREP SCHOOL STUDENTS ATTENDING THE SERVICE ACADEMIES 
= : > D —_ ° . incest nae 
Fifths SAT-V SAT~M * * EC ~ fT or AM : 
2 E° 0) E fe) E oO E oO we 
_ aoe 
Top, 59 37 64 ST» 93 37 81 37  eauionaoaes 
° ™ C 
-.\ > 2nd 63 4 44 64 44 67 44 70° ~3= 44 
. \ . } 
3rd. 64 85 63 85 7 64 85 63° 85 : 
4th 65 58 63 58 . 59 57 * 86 57 a : 
Bottom | 65 92 62 92 52 ” 92 45 92 
chi? = 32.79 ‘ 40.24 63.38 _ 90,346 


e ¢ 


e e 
’ t 


From the sumarctow do table bb, tt da apparent that the aebuadl pertorie 


meee ot prep school students attends ne the Heng ice fondantoa-wik stent’ toantly ° a 
Poorer than what was predicted, and that such was, the. ¢ase more so with pro- he 
“+ dictions from the dchievement tésts than from the aptitude tests. Be Ka 
| “ eS np 
One question rematns Co be answered; #.@., are there stpmai et tenirt —s — 
Atiferences among the Prgap Schools With respect to prodicted vs. actual ' : 
performance aty the Service Academies? The schools for which there was’ a 
suffietent number of cases to provide soma answer to the question are B, A, 
J, G, F, and BE. The predicted and obtained distributions by prep schoots 
7 are presented ino Table TLE in Appendix D. The hypothests that the college Mg 
performance was consistent with the performance predicted from the College a oe 
Board tests was accepted if-the differences between the two could have oceur- ~ Pee conc, 
red by choice in less thar 99 out of lOO times, The Chi Square test was™used , * ie 
the value required tor rejection of the hypothesis being 13,277, . oo 
- be . 
The performance of cadets from schools B, G, F, was consistent with 
their predicted pertormanee for all four tests, | : ° 
\ 
School J's performance was significantly lower than that which was L 
predicted from scores on the Intermediate or Advanced Mathematics Test, rar aie 
/ . Pe 
TRE performance of cadets Crom schools A-and E was significantly lower : & ee 
than predicted pertormancg for all four College Board tests, : ae 
[ | ot a | 


< ‘ 
2. Prep School Students Attending Civilian Colleges 
< ¢ 


Of the 412 who had not gone to a service academy, cards. were sent*to ® i 
349 on whom addresses were available, asking the student whether he entered * 
college in September and, if so, what college. Two hundred twenty-eight 
(228) responded of whom 165 indicated they had entered a college in September, 
1963, A cover letter explaining the project was sent to the registrars of = e 


ms F ’ eR, 
the 1l7 cotleges attended, together with a formin which they were asked to : a 
Indicate the approximate class standing of the student in (a) his’ math or 4 : 
Physical seience course ant (b) his English course. Adequato data was : . 
obtained on 130 students, ‘ ‘ ; 
- ‘ ° « é 
58 Jt is worthy of note that the civilian col ee sample is considerably : 
Yess.,capable than the service academy sample on the basis of average College ' 
Board scé@res (Table 15). * 
a 
4 . 
: t 
“ ‘ J ry é 
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SUMMARY OF MARCH COLLEGE BOARD SCORES OF PRER SCHOOL STUDENTS 
ENTERING CIVILIAN COLLEGES AND SERVICE ACADEMEES * + - 


Tabte tS 


Service Academies" Civilign Academies 


N MSD N M sD 

é : 3 ‘ 
SAT-V 242 575.67 60,69 "123 497.57 BL. 85 
SAT-M , 242 663.14 59,36 - 123 867.22 96,53 
Ko. S(O 590.07 70,03 105 «487.50 90,72 
EM 7 223 688. 67 56.01 94 "570.74 109,55 


AM % 121 659.40" 76.44 30 550.60 106,45 


. 


Assuming some degree of comparability between the service academies and 


thi@ civilian colleges represented, it would be expected, that the latter's 
college performance would be relativefy poorer than that af the former. The 
performance of the civilian college sample in thé major math or science 
course and English course is presented in Table 16, t 


ee eee 
¥ 


2 Table 16 


~ 
‘ 


DISTRIBUTION BY FIFTHS OF PREP SCHOOF, STUDENTS IN CEVIELIAN eoiied : 
FRESHMEN MATH OR SCIENCE COURSE AND IN ENGLISH COURSES 
Class Fifths Math or | on Science English 
Top = 12 a 4 
2nd : ‘ie ee 13. 
- 3rd | . aa “ * al 
4th | | 18 23 
Bottom 26 31 
Failed . | 28 . yn 
% 
- & . 
° ; a 
. 21 ’ . 


a U 7 . 
a 
Som effort wns made to determine whether the performance tu eivibian 


cOllegesy was congiutent with what was te be osypected an thetbasds of the 
March Colloge Board test scores, However, since only 384 of 117 colleges 


reported froquency distributions on SAT-V and SAT-M in the Manual of Colleye heey 
Board Profiles, {t was impossible to determine the relative standing en the ee 
tests for each student, Nevertheless, the average scores of the 34°on which ee, 
distributions were available were computed, For 22,508 subjects on SAT-V, 5, ; : 


tho mean seore was 521.80 and Che standard deviation was 99.30.°) From the 

. simmary statistics presented in Table 15, one would ‘expect the prep school 
group to perform somewhat less than average im Bnglish and about average in 
mathematgos.:' The distribug ions of performance in math or physical science 


courses and in English for the civilian college sample does not seem to pe ' . 
inconsistent (Table 16).° ° $l 
| ; Ngee 
Discussion of Results ee Pei 
. . - ee 
From thy” foregoing analyses, the following results are hoteworthy : ° ‘ 
; at. Both SAT-Verbal and Mathematical test scores inereased significant ly ; . 
A abeyoud what has been considered typical for a senior year in secondary’ school, | 
The College Entrance Examination Board (1) reports an average increase of 40° a ae 
points (Mate students) in SAT-Verbal and 43 points in SAT-Mathematical scores ee os 
‘trom preliminary to final testing (March, 1963 through January, 1964). Both oN 
Groups tl and 2 (Table 4) show significantly. larger increases in SAT-V and , 
: all groups (Table 5) show significantly larger increases in SAT-M, —e 
. -O.  There7 are no normative data available for senior year gains on thes , 
achievement tests. One can only surmise from the distribution of achieve- 
ment test scores for entrants from prep schools (Table 12) that the average ; 
increases. tn scores on the achievement tests are atypical. Seiden 
. o - Pa 
ec. There are significant differences among the aghools with rgespect to nies 
the degree to which scores are increased even when adjusted for differences : } 
in initial scores. Those schools for which the greatest increase in scores ; s 
was obtained, also had superior input as measured by the September scores, , ' 
-. ahince these differences. among schools remained eyen after they were con- 4 
trolled for differenoes in input, it is apparent that ther are differences ‘ 
in curriculums’ Tt is logical to assume that schools eet ine only the 
= better equipped student are able to go into subject matter at greater depth 
and at greater lengths than those that accept the less equipped student, 
d. As a group, cadets from prep schools performed Significantly poorer ; a . ° 
than was predicted, The adopted correlation of .35 between College Board : 
scores. and subsequent college performance was conservative in the Light of 
the aethyl correlations of .40 to .48, , , . 
; “Analyses of performance of cadets’ from separate prep schools was carried ; 
out but with more stringent requirements for rejection of the hypothests than ; Paes 
were adopted for the analysis of the performance of the group as a whole. In’ ° "fe 8 
: : 
“a ; : st eel 
| | “4 22 @ 
: ‘ : } 
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* fy 


“other words , 
no sipnitteant difference between predieted and actunt poerhormanee, 
quently, the fact that no significant dif fora@ncos wore | found between predic tod 
and actual performance for certain Prep Schdols does notepreclude the possist 
bility of there actually being a real ‘ditforence. On the other hand, the 
degree of contidence that can be placed in the results which showed a signi- 
‘fteant difference be tween phedtered and actual performance is considerably 
“greater, 


we - ee to err in favor of the hypothesis that there wags 


Conse~ 


. ‘ 
- 


“There were no sipniftenant ditferences betwoen actual performance nnd 
performance predicted From any of the College, Board test scores for cadets 
frow three prep schools, B, G, and BF. Ati other schools showed actual per- 
formance to be significantly lower than per formance ~prediet ed from the 
Intermediate or Advanced Mathematics tésts Finally, two sthools, A and E, 
showed actual performante significantly nakae performance predict ted from 
scores on all College Board tosts. | . 


\ « 


‘ ; 
-AsS Was expeeted, achievement test scores a... rnisad tar more than th i 
Japlitude test scores, and The math achievement scores more so than the 
English achievement scores,  Achtev reoment tests ‘are by nature content-oriented; 
hence, the more intensive the coverage of English facts, literature, and 
mathematical areas, the more likely will scores be raised. Nevertheless, the 
achievement tests are important tests for college selection, The results of 
_this study would seem to indicate the scores on_achicvement tests for — 
~ applicants W ho_have_ attended a_prep_s school, offering a _one-ye ar curriculum 
ought to be played down, ‘or or_at least. adjustments | made for scores obtained, 
Such adjustments 
4 = should “be done separately for each institution. 
That students from two prep schools should perfokm significantly below 
. what wags predicted from the SAT test scores does not necessar ily mean that 
the schools in. quest ion have found the answer: to boosting said scores signi- 
ficantly above the ability of the student because most of the stadents from 
the two schools in question entered the same institution. An institutional 
study should be made with gpecial attention being given to the type of 
-, . student accepted from the two schools. [t is possible that a large majority 
of. the students in question may participate in a very active extracurricular 
program in their Freshman year, If such were the case, it is understandable 
oa that their performance would be somewhat lower than the predicted performance. 


can be easily de Lermingd _by statistical procedures. and 
AEP aaa ae a 
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Observattons 


The resukts pf the study lead to the following observations: a 
< . i 
a. ose prep schools offer {ny oneryear rd aoa for boys secking , 
admisston to college would assis st the student mos t re., Final College 


Roard: Scores would be more consistent with the sttdent's actual pemormance) ‘ 


if they would gear thetr curriculums to the Freshman college level. 


en cere ee 


x 7 . i ae 


a 


hb. Those sehools that fecept anyone whe wishes to enter, do the boy a 
disuerviges if they only succeed’ tn ratsing College Bowrd scores to a lowes 
acceptable by the college of the applicant's choice. 

ec. Schools that accept any students who wish to come, do tho boy a real 
service tf they concentrate on content without any special attention being 
given to tests and test ttems., A young man who is seeking assistance of the 
sort offered by prep schools with one-year eurrteculums would do well if he 
examined them as he examines’ four-year, colleges; i.e., for strength of their 
curriculums; net on the basis of how many of the school's graduates got into 
college, but how well they do after they are in college. - 

‘ . ; “1 

Finally, prep schools which terminate the course of study with the ad- 
ministration of CEBB tests tn January or March can hardly compete with those 
requiring the student to stay on until the entl of May if the student is to 
obtain a favorable recommendation from the prep school. The adoption of such 
a policy by all prep sehvols would have a beneficial effect. Not on ly would 
the student ap better prepared, Sut tt would also follow that students coming 
trom the prep schodls: would receive considerably more favorable consideration 
by the four-year colleges to which they apply.- 
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APPENDIX A 


THE EFFECT OF REPEATED TEST TAKING ON FIAAL CEEB 


CA 
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TEST SCORES 


t 
APPENDIX, A 
. f ~~ 4 ms 
The: Effect of Rupeatod Test Taking on Final Scores : 


Students from the vaftous schoots coutd and did take the College Board ’ 
tests at remrlar administrations more than once beltweeh “the oxportiment al 
administration in September and the criterion administration in March, Some 
fook thé tests in December and/or January as well as in March, Hoefore they 
could be chmbined with those who took only the March exans, it was necessary . 
‘to determine whether there Were any Sree ae differences, in March seores J) 
for the vasious groups, on 

Becatise preliminary examinations showed marked differences ainenge sehooels- 
in the average September College Board scores, it’ was necessary to select 
schools whose students differed suffietently in thetr test taking to permit 
analysis within sehools, Three such schools were identified: the USNAPS on 
nll but Advanced Math: Sullivan on SAT-V and SAT-Math, and Bullis on Hagel ish 
Conpositionfand Putermediate Mathematies. Summary statisties for the three 
schools are presented in Table 1, : 

The results of the analyses of variance on students at USNA nnd Bullés 
showed no sfynificant differences among groups. Significant differenees in 
March SAT-M scores were found for Sullivan, which were eliminated when ad- ‘ 
justed for diffdrences {p September scores (analysis of covariance); A 
Stgnificant differencé was also found in the September SAT-V scores for the 
Sullivan students, but no differences in March seores; Wor were any signi~ 2 
ficant differdnees found in March SAT-V scores when adjusted for differences 
in September scores, ; < 
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MEANS AND STANDARD DEVIATIONS OF COLLEGE BOARD SCORES OF STUDENTS TAKING THE EXAMINATIONS IN 
VARTOUS COMBINATIONS OF NATLONAL | ADMINISTRATIONS 


- 


Test-taking . 
Combinations 


Sep-Mar — 

Sep-~ Dec-Mar 
Sep- Jan-Mar 
Sep-Dec- Jan-Mar 


‘ 
‘ 
* 


Sep-Mar 
Sep~-Dec-Mar- 

Se p- Jan-Mar 
Sep-Dec-Jan~ Mar 


Sep-Mar 
Se p-Dec-Mar 
ep- Jan-Mar 


Sep-Dec-Jan~Mar * 


\ 


September Scores 


M 


500 


A78 


471 


4164. 


iy 
. 
ae 


USNA 

SD M 
88 542 
68 511 
74 524 
75,0 510 


SAT-MATHEMATICAL 


SD 


82 
53 
68 


March Scores 


68 


64 
91 
66 
61 


. 


Table 1 


SAT-VERBAL 


os 


4 
ae 


ENGLISH COMPOSITION 


USNA 
68 629 
82 591 
77 ~~. «+6421 
60 610 * 
SNA \ 
72 864. 
12 566 


58 573 


33 


| ~ SULLIVAN 
September Scores 
MN, SD 
452 76 
373 77 
467 ° ‘84 
SULLIVAN 
485 82 
462 88 
532 93° 
SULLIVAN 
476 78 
465 57 
460 a7 


March Scores 


SD 


Sep-Mar 
Sep-Dec-Mar 
Sep- Jan-Mar 

Se p-Dec- Jan-Mar 


re) 
CERIG 


a 
4 “da 
on 
. | USNA: 
Septer:ber Spores 
N M SD 
110 305 : 73 
6) --- =7 
52 SQ7 77 
8 567 . 84 
> s 
a 
- q 


id 


Table 1 (Continued) 


INTERMEDIATE MATHEMATICS 


. 
u 


& 


March Scores 


M 


630 
632 
- 659 


SD 


; N 
SULLIVAN 
September Scores March Scores 
M sD M sD 
459 59 579 50 
Se - — ee 
503 64 623 64 
491 86 624 72 
¢ 
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THE EFFECT OF PRACTICE ON COLLEGE BOARD SCORES — - : pant os 
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APPENDIX Bo” 


Tho Effect of Practice on College Board Scores , ee 

on ee ee ORE gE gene eye a eee a Ne eee ee ME aE. og F ; . bat ; 

To ae 

Although inttial correspondence with the schools participating ino the . Woman 4 
study had indicated that several had a period just prior to the March exams ae eet 


which was reserved for "dry runs" of tests comparable to the CEEBs, it 
developed that only one school devoted a pertod of time of sulltedent length . 
to Warrant spectal testing to determine the effect of prietige. At Columbian | ‘ X 
. the last ten days were devoted to tegt takifg., During that period, tests 
comparable to the SAT tests, the English Composition, and Intermediate 


Mathematics were administered and studied, This process was carried out - ‘ 
. a ae : - 3 
twice, each test administration being followed by a review of “the test. Ls 
' rr oe 

On the day preceding the practice period, the entire experimental . 


battery was) rez ministeted (February 15, 1968), Motivation wag maintained 
at a high level by having the Procfors (Columbian instructors) indicate to 
the students that) the administration was consistent With the program al 


‘ Columbian, plus the tact that the tests being administered were actually 
operational at that time. The results of the study of the effect of practice - 
are summarized be low, : - - 
Aen 
Table 1 : , ’ 
. e s 
PRE- AND POST-PRACTICE SCORFS ON FIVE COLLEGE BOARD TESTS 7 : 
| y 7 | 
Pre-Test (February) Post-Test (March) . PRe=Post: < Seo eeeee 
N Mo sD M SD ee . \ 
: Feb-Mar T Value elas 
° , . . 
SAT-V 142 493 — 94 502 B3 7993 1, 870* _ 4. 
5 . . . - 
SAT-M 142 560 ~ 106 556 93 9022 NS ' 
oo, F.C, ~ 116 505 86 513 88 .6927 1,182 (NS) 
% 
1.M. 112" 574 108 598 100 8466 4, 336** 7 
A.M, 15 561 {106 “$60. 101 ,8936 . NS * a3 
lone-tailed test for sorrel aed means, 
; *Sipnificant at the .95 level. . 
**Significant at the ,O1 level! ’ 
Cee 7 . 2 : . 1 
The results of the study indicate that pract ice alone did affect _ 3 
: certain test scores, ‘the Intermediate Mathematics in particulars, “The fact t 
that not all five showed significant increases in scores attests to the ee 
adequacy of the level of motivation at the pre-practice session, ' Sy 
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RELATIONSILEP BETWEEN OTHER BACKGROUND VARXABLES AND CEEB TEST SCORES - 
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Relationship Between Other Background Variables and CEEB Tost Seores 
4 
were a a ne ca cl ee ee ele a a NS OE pe ne ere 


Addit tonal information which had been obtained at the time of the initial 
Administration of fie College Board tests was examined to determine whether ° 
‘ March score difterpneces could .be further reduced,  Theso included: —— ‘ 


a, Number of secondary sdhoois attended; 


b. Number of math courses: taken; 


hs 
; c. Number of English courses taken; of es, 
“dad. The High School Rank Seore!; and 
_ 2 
e. Ancintelligence Index 
Correlations between the se lected background variables and the College : 
Board tests are presented in Table I, The Intelligence Index, HSR, and ; bt 4 
-Number of Math courses were the most promising but once the March sdcores i ~ 
were controlled for differences in September scores, the’ background variables ad 
made no sigmificant contribution. The means and standard deviations of the  « é 
background. ‘variables for each of the groups as defined in Table 3 are. pre- ; ene 
sented below (Tables II through VI). ' . ' 
) 
nid : t 
° ‘ ots 
y) ( he ye 
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nw K- 
the Wigh School Rank was converted to a normalized distribution with a mean A ss 
of 50 and a standard deviation of LOL. ee 
, * , 
2h he Intelligence Index is a stanine conversion of a variety gf tests used in Sas 
secondary schools as indexes of intellectual deve lopment anor aptitude, ; ‘ 
The conversion tables are prewonted in Table VII. 4 Premmemnee 
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1 


: “ 
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) Teme ne, a eine . i ae 38_ c : 7 s . rw Sa : ¢ 


a es? a 
Table | 
~ : 
: . ———— raha 
CORRELATIONS BETWEEN SELECTED BACKGROUND VARIABLES AND pay 
SEPTEMBER AND MARCH CEEB SCORES. ; yt pe, 
; é B 7 nn Le 
| SEPTEMBER ; 
: CEEB Intelli- ‘No, of Sec-  * Now-eot Math No. of English 
’ Tests “eNee - ondrry Courses Courses 
Trader x Schools oe HSK 
: r (N) r (N) y (N) r (N) , r (N) 


SAT-V 366. (878) 030 (1064) 6.178 (1063). 014 (1062) 394 (812) | 


SAT-M .313) (880) .024 (1066) + .329 (L065), 082 (1064) 2471 (814) * a 
EC Sta (879) .007 GCLO64) /181L (1063) LOLS (L062) .435 (811) 
“IM - ,278 (878) 004 (1062) 390. (1061) .050 (1060) .499 (810) ; 
. 
AM. 6281 (700) -O38 ( 873) 6419 ( 873) + . 110. ( 873)» 543 (659) 3 
. Hy , : oN of. 
fquesagneem: 
: MARCH 
q | oe | 
SAT-V .239 (568) 6013 ( 694) ,177 (693), ee 692) . 372 (546) _ 
7 e oy : t 
‘ SAT-M 1293 (568) .045 ( 694) — .303 ( 693) .003 ( 692) ° .,458 (546) eee 
. : . i an 
Fe, 6290 (511) 060 ( 630)  .149 ( 629) O18 ( 628) .436 (495) Fe 
oe See eS no : : : aaammeael 
iM .268 (487) »030'.( 591) -.280 ( 590) - .017 ( 589) | 452 (467) 
ss : or ; ; 4 - ; ‘ 
AN 320 (163) 173 € 245) "256 (245) 162 (245) ~~, 602. (198) 
ee 4 : % e 
? ‘ 
“< ‘ 
y 
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. . a 
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Table 1 


MEANS AND STANDARD DEVIATIONS OF SERECTED BACKGROUND VARIABLES. FOR GROUPS 
IDENT IF TED AS SIGNIFICANTLY DIFFERENE ON SAT-V INCREMENT SCORES 


Background Vartables 


School Inte Llhigence No, SS No. of No, of 


Groups . Index Attended Math Courses Eng. Courses HSR Seore 
M sD M SD M sD M SD M SD 

C.J GAO 20b 158 72 3,900 BE 404 AL 1935873 
(N=52) (N93) (N=93) (N=93) (N=63) 

A;H,E, 6,84 2.09 Lots (53 3.96 1.01 3.08 646 51.17 +42 

F,G,H (N=797) (N=915) (N-914) “(N 913) (N=718) 

Dd 6.42 1.84 2.23 693 3.08.78 3.46.69 50,50 8.84 
(N:7) (N 26) (N=26) (N26). (N= 4) 

I 5.820 1.72 2,00 1.90 3.53) 484-390) 4050.67 7,97") 
(N=22) (N=30) (N=30) (N=30) (N=27) 5 

—@ 


5 Table LIT 


MEANS AND STANDARD DEVIATIONS OF SELECTED BACKGROUND VARIABLES FOR GROUPS 
, IDENTIFIED AS SIGNIFLCANTLY DIFFERENT ON SAT2M [INCREMENT SCORES 


‘ ‘ Background Var tables 
School Intelligence No, SS No. of No, of 
Groups Index Attended |= Math Courses Eng. Courses HSR Scores 
‘ M SD M SD. M .SD M SD MC SD 
= - . é . 
. ©,F,G,J° 7.61) 1.90 1,43. 67 24,17 WO4 4.07 246 95..25 8.38 
*  (N=310) (N=410) (N=410) - (N=410) (N=830)) 
‘ A Q 
ABE 6.42 2,02 1,40 (67 3,76 1.00 3.91  .46 48.45" 8, 80 
(N=494) (N-:536) (N=535) {N-:534) (N=399) 
DH, I §.793 2,06 1.56 75 . 3.75 81.00 3,89 18 44.61 8.60 
(N= 74) (N=118) (N= b18) (N=183) 


(N=118) 


_ENC . Jj oe — 


Table TV 


. 


’ 
MEANS AND STANDARD DEVIATIONS OF SELECTED BACKGROUNR, VARTABLES FOR GROUPS 
“EDENTIFIED AS SIGNIFICANTLY DIFFERENT ON ENGLISH COMPOSITION INCREMENT BCORES 


; - * . Background Var Lables : : 
School — Inte Lligence NO, SS No, of “No. of, 
Groups Index Attended Math Courses Enge Courses HSR Score 
° Vv . 
M SD M SD e M sp M sp M SD 
C,E,G,J 6.70 2.69 1.35 ..63 4.16 90 4,02 ,37 54.57 8.23 
- (N=319) (N=420). (N=419) (N=418) (N=331) 
as A,F 7.5¢ 4.62 L483 -.67 3.85 tO4 8 4,03 47 9 48,72 9.39 
; (N=:393) {N=403) “* (N=403) (N=4103) (N=333) 2° 3 
B,Il, I 5.12 2.72 1.50 .66, 3.69 §.97. 3.81  .54 48.19 8.92 
(N=160) (N22 66) (N=2'16). {N=216) (N= 145) 
D 6.43 1,84 2,23' .93 3,08 .78 3.46 ..69 50,50 3,84 
(N= 7) ‘(N= 26) (N= 26) (N= 26) (N= 4) 
4 
-_ - Table V 


ve , on cy 


_ MEANS AND STANDARD DEVIATIONS OF SELECTED BACKGROUND VARIABLES FOR GR@NPS 
IDENTIFIED AS SIGNIFICANTLY DIFFERENT ON INTERMEDIATE MA‘THEMATICS INCREMENT 


School 
Groups 


F,G,J 
A,B,C,E 


H 


- 


Inte Lligence 
_ Index 
M “sp 


7.73 1.85 ° 
(N=289) 


6.41 2,02 
- (N=515) 


5,88 2.21 


(N= 22) 
5882 1, 72 
(N= 22) ; 


SCORES 


4 : . 
‘Background Variables 


No, Ss ~~ 
Attended 
M*: SD 


»67 


61 


~ 1.55 
(N= 62) 
Wood. LOO 
~ (N= 30) 


No, of 


M SD 
4% 


4.19 92 
(N=380) 


3277 — 
(N=564) 


@e 
3.53 2.84 
“(N= 30) - 


Math Courses 


WOl 


$ 


414 596) 
= (N= 62). . 


4 
No. of 
‘Eng. Courses 
-M SD 
4.07 °-,47 
(N38 1) 
3.91 16 
(N=563) 
st 
4.06 225 
(N= 62) 
-_) 
3.90 240 


(N= 30) , 


4 


HSR Score 
M SD 


96.02 7,90 
(N=307 ) 


48,23 8.79 
(N=422) 
44,21 8.27 
(N=. 52) 


free 7.97 
(N= 37) 


Table VI 


MEANS AND STANDARD DEVIATIONS FOR SELECTED BACKGROUND VARIABIES FOR GROUPS 


a ion 
IDENTIFIED AS SIGNIFICANTLY DIFFERENT ON ADVANCED MATHEMATICS [NCREMENT | Netty 
, siylgee 
SCORES , ’ ne, 
~ ‘ : ra 
® Background: Variables — 
School Intelligence “No, SS No, ‘of * ‘No, of . 
“Groups fndex* Attended | Math Courses Eng. Courses HSR Score 
M SD M SD M - SD “M sp Mm. SD 
F, G 7.86 1.78 1.39 (66. 4.25 (95 4,08 (48 56.64 7.66 : 
(N=2564 (N=315) (N=315) (N=315) (N=267) < Age fgg 8s 
ee 
A,B,C, | 6.23 2.32 1.46 (66 3.71 .99 3,96 46 46.51 9,05 
Hyd (N=418). (Nx5 13) (N=513) (N=313) (N=372) 
ry Aw - 
I (§.82 1,72 .2,00 400 3.53 . 84 ° 3,90 ,40 50,67 7,97 
(N= 22) (N- 30) _ (N= 30) | (N= 30) (N= 27) 
- : ‘ 
1 oy ve * 
: . a 


" . a 
> = 4 
‘ Ee 
' w Bre aan 
‘ o 
e 
‘ 
° ‘ 
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7 a ae : ; : ae a ~ 


fg «THO Le VIE _ . 


Stantne LORGE-THORNDIKE OTIS SCAT Total 
BR ane te 
Verbal IQ Dev. IQ, ; 

9 125 T 122 -T 301 

a 118-124 116-121 296~300 
¥ . 
q LLL-117 LLO-LL5 290-295 
6 104-110 104-109 283-289 
5 97-103, 97-103 277-282 
ie , 

4 .90- 96 91- 96 271-276 
3 83-. 89 85- 90 265-270 

2 , 17- 82 79- 84 " 259-264 

t 
L 76 738 Of 258 | 
4 ‘ : 
3 

° P 

a c 
= i ? wm ro t * 

» : Vo: 


CONVERSION TABLES USED FOR SELECTED INDEXES OF INTELLECTUAL ABILITY . 


9 


T-M 


129 T 


120-128 


116-125 @ 13-119 


PMA ACE 
IQ | Dev. IQ 
120 fF 136 
112-119 126-235 
104-111 
96-103 106-115 — 
— 88- 95 96-105 
80- 87 86- 95 
72- 79 76- 85 
64- 71 66-75 
63 i Nsw J L 


107-112 


99-106 


91- 98. 


? 


83~ 90 


73- 


_? 


OSPT 


103 T 
90-102 
T7- 89 
64- 76 
a®. 63 
36~ 42 
29- 35 


22~ 28 


IQ 
26 4. 
119-125 
112-118 
105-111 
98-104 
91- 97 
84- 90 


77- 83 


76 OL, 


“Sy 


hae.) 


Stantne 


Ratio IQ Total IQ 
: ( 
9 127. 4% 126 * 
8 120-126 1194125 
z 
7 113-119 112-118 
6 106-112 105-111 
5 99-105.” 98-104 
4° 92- 98 91- 97 
- cn 91 B4- 90 
y 2 78- 84 77 83 
bie WF ab . 7 ty 
t 
=. ~, tad Pod as ~ 
J i 
ie to. . 


HE NMON=NELSON CT\MM 
pee ge ee ree 


Table “VIT (Cont tinued) 


WAIS (W-B) STEP Math 
(12th Grades 
Pi sil irisd diode 


129 % 


121-128. ° 


113-120 
105=112 
96-104 
88- 95 
80- 87 
T2~ 79 


ane 
Mw 


296° 4 


290-295 
284-289 
278-282 


272-277 


t 
266-271 


260-265 


254-259 


253 «lp. 


rv 
« NMSQT 
_ Comp. Scaled Selection 
Score Score 
29 124 4 
25-28 © 109-123 . 
21-24 95-198 
17-20 oN, 19- 93 
13--16 64- 78 
10-12 49-- 63 
A fae Gy > 84-48 
4- 6 19- 33 
ab wy 
% 


AGCT 


ww 


130 4 
122-129 
114-121 
106-113 
97-105 


89- 96 


125 4 
\ 


118-124 


LL1-117 
105-110 
96-104 
86- 94 
17- 83 


69- 76 
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"TEST. SCORE INTERVALS FOR EACH 20% OF THE ENTERING CLASS TO THE 


SERVICE ACADEMIES, 


- 


DISTRIBUTIONS BY FIFTHS ON ENTRANCE EXAMINATIONS FOR FOUR: 
SERVICE ACADEMIES _ . 


PREDICTED AND OBTAINED END-OF~FRESHMAN-YEAR CLASS STANDING 
OF STUDENTS FROM PREP SCHOOLS 


“ 


Table 1 ; 
TEST SCORE INTERVALS FOR EACH 20% OF aie ENTERING, CLASS TO THE SERVICE 
: ACADEMIES 
* *. SAT-V 
Fifths USAFA * uUSMA > USMMA USNA 
Top 662 *& above G41 & bars 617 & Seve 646 & above 
2nd | 621-661 596-640 557-616 606-645 
3rd 580-620 916-595 526-556 971-605 
4th 530-579 502-545 485-525 531-570 
Bot tom to 529 to SOL to 484 . Lot s30 
SAT-M E 
Top 732 & nbove 695 & above 671 & above 71L & above 
2nd 699-731 664-694 630-670 680-710 
3ra . 664-698 630-663 598-629 619-679 
4th : 623-663 | 585-629 a 567-597 : 613-648 
Bottom: to 622 to 584 a see . to, Gle2 
‘ \ ‘ 
; ; a 
‘ e : . ‘ 
{ 
1 4 Bd 


% 
USNA 
7 


\ 


637 & above 
998-636 
968-597 
921-567 : 


to 520 


= Thble F continues - 
Fitths USAFA USMA  USMMA 
: ¢ 
ENGLISH COMPOSITION 
: Top 657 & above 631 & above OBO & above 
‘ 2nd 6 Ld-656 974-630 945-579 
3rd 57 1-613 531-573 498-544 
i 528-57) 487-530 455-497 
Bottom to SAT to 486 lo 454 
INTERMEDIATE. OR ADVANCED MATHEMAT [CS 
Top nay & above 698 & above 650 & above 
2nd ; 685-736 643-697 | 601-649 
3rd ' 637-684 601-642 565-600 — 
ra a ‘ 
ath 580-636 559-600 525-564 
Bottom to 579 to 558 Lo O24 


. 8 


a 


TOO & above 


665-708 
626-664 
986-625 


to S85 


‘<) 
ERIC 


iin 


. ~~ 
a e$ ‘ 
Table 1 ; 
DISTRIBUTIONS BY FIFTHS ON ENTRANCE: EXAMINATIONS FOR eer 
-FOUR SERVICE ACADEMIES. He, . 
7 SAT-V_ SA'T-M a 
Fitths USAFA  USMA“~USMMA —sUSNA USAFA USMA  USMMA ~~ USNA hs 
_ Top 21 6 ys at . 27 20 “2 13 
2nd woo. LL 4 20 . 26 10 3 22 
3rd 28 14 3 21 28 12 3 22 : Ne be 
4th 29 7 l 46 23 5 2 35 - 
Bot tom 1S 8 6 33 8 9 . 7 34 
é 
a = . EC [ or AM ns 
Fifths USAFA  USMA  USMMA — USNA USAFA | USMA —-USMMA_—sUSNA 
Top 35 23 9 28 58 33 “9 38 a. 
_ 2nd 32 10 1 31 33 at 2 26 
: f 
3rd 30 12 2 29 i6 9 a 29 
4th 6 ~~. 9 3 27 5 2 1 23 ~~ 
Bot tom 9 2 2 15 0 an | . 2 14 , 
+ » 
i] 
Q ) : 
e : : ‘ 
‘\ + 7 * 
* oOo . 
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Table III 


- ow 


*PREDECTED AND OBTALNED END-OF-FRRSHMEN-YEAR CLASS STANDING OF STUDENTS FROM PREP SCHOOLS 


School “BR. . 
~ Ee OF 
¢ 
Fifths 
Top 4 2 
2nd 4 2 
3rd 5 5 
4 @ x 
ith 5 ¢¥ 


Bot tom 4 9 


Chi Square 
Valuesl 6.20 


Top 4 2 


2nd- 4 2 

3rd 4 5° 

4th | 5 4 
- 


Bottom 5 9 


Chi Square 


Values 5.68 - 


“ 


g 
ERIC 


—— AL ee Bese 
= 
7 2 
8 2 
8 12 
8 8 
9 J6 
15.51. 
8 2 
8 2 
8 12 
8 8 
8 16 
21.00 


ee. 
: 6 
5°] 
4. 2 
4 3 
4 8 
3. 6 
11.45 
3. 1 
4. 2 
4 38 
4 8 
5 6 
6.78 


I°- SAT-V 
GG ____seF 
Ete E 
is 214% a 
19 22 10 
19 22 10 
19 13 10 
17 14° 10 
3.36 3.22 

Il - SAT-M 
21 22 12 
20 22 ll 
19 22 10 * 
17 13 9 
15° 14 9 
7 
1.67 4.14 


0 


14 


30 


7.16 


- 1 97 Y. ; j 
a5, ‘ 
ae me ee ORL Bsn tae 
i 
‘ ‘ ON 
Schoo] - ; B eee _A 
E* Oo EO : 
Fifths 
Top 4.042 8 2 
2nd 1 | 2 8 2 
3rd 4 5 8 12 
Ath. 5 j 3 867 
Bottom 5 g 7 16 
Chi Square 
Values 5.65 22.67 
Top 5 2 10 2 
2nd 5 2. 8 2 
dra 4 Ms) 8 12 
, 
t - 
ia 4 #4 7 7 
Bot tom 4 9 6 16, 
Chi Square 
10,10 29,57 


Values 
*=Eypected; O-Obtained 


4 


1 Nera lue of 13,277 is significant 
As ee 


eo... ». : 
ENC 9 oe, 


Table ftt (Cont inued) 


: Ill ~ FC 
eae a ns ep ee, 
EO EB 6 E oO. EO 
5 23002 13 8 16 3 
1 2 el. 22 1210 17 5 
4.3 18-22 10 15 15 23 
4 8 17 13 9 8 14 14 
3 6 ¢ 13.5 14 7. 10 13 30 
11.45 2.13 ~ 6.15 "45.53 
; 
IV - IM or AM 
~5  } 27 21, 5 8 16 3 
5 2 22 22 12 10 16 5 
4 3 18 22 10 15 15 23 
3: 8 15 13 ° 8 8 14.14 
3. «6 10 14 . 6 10 14 30 
‘ ¥ | 
16.50 4.09 8.82 © 40.67 
-at the .01 level. 
52° f 


ry o 
| . 
ae ut , 
©, Wy tT 
E" oO 
3 O 
3 1 ' 
4 5 
3 3 
3 7 
. 2.91 
4. 0 3 
4 1 
\ 3 8 
3 3 
3 7 / 
11.25 
‘4 
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PERFORMANCE FROM PERCENTILE DISTRIBUTIONS ON AN 
INDEPENDENT VARIABLE FROM A NUMRER OF SAMPLES 


| : ee 
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e ; . ; _ : 
. 7 
° “i ‘ 
oe t ‘ ms 
e vw e : ‘ : Pi “s 
APPENDIX FE . 
e 
Obtaining Co Combined Distribution OF Expo ‘cled Performance Prom Percentile 7 . 
Pe Pee | ached ppcinas al ere »* oe ae 
Distributions on.an Inde pendent “Variabld froma “Humbor ‘of Samples ; a 
ar PtP OE NEE IIS TOC LO A SOO IT OETA LOLA SOE RT COLTS ALE IT ABD A RD RE CTY EOE CA LO NO AEE A, \ ; id et \ ¥ A 
ee 7 : | Oe: Va 
When acstandard score conversion $8 not possible becauso of nao lack of 3 Pitas 
‘ sk D “ ee alt 
certain necessary. information, an effective conversions can be obtathed tf a 
1 Say Hg ” F * 
: the relative standing of the members of the ‘samplos to be’cohbined ts known, ° oy 
. Fos . : = . > . 
a - . Z . . 
. The conversion can be made as refined as considered necessary; 1.06.5 a 
identifying the relative position of members of the separate samples tn 
. s 
torms of unit percentages, tenths, fifths, or even halves. This can be done ‘ 
for both the tndependent and dependent variables if necessary, but it is : 
better if the actual standing of the subject is available on the dependent. . Wy 
—--- vartabtes.-- By converting the mensurement of one variable ‘to a-@tandard SR 
: ars 
score, a mubtiserial can then pe computed between the independent variable 7 a 
(in standard score form). . ‘ . 
- « 
An even more conservative estimate of the relationship between the e 
independent and dependent variables can be obtnined by computing a product=* i z 


moment correlation between the raw scores (independent variable) and the 2 | 
converted dependent variable for all groups combined, as was done in this 5 Nos 
study, The obtained correlations are presented in’ Table 13. . : 


. : . ; 


Given the relative standings of the 
Cvartabte and the correlagion between the 
7 the predicted (erpected) "Btanding, of the 
. variable can be obtained by referring to 


combined samples on the independent 


jndependent. and dependent variable, 
Cy z 
Sample members on the dependent 


the Tables made by Richard P,'T, 

Seott (5) showing the predicted location of an individual in a dependent 
measurement from his standing hh an independent one. Tables are available . 8 
for all correlations from .05, to .95 in ,05 intervals, 


For this study, the table for an r of ..35 was used, In Table 14, the . Ld 


distributions by fifths of the combined samples on SAT-V, is as follows: os 
Top ae 51 F 
r : 4 
Qnd fifth. © 54. — 7 a oe > 
. “ee 4 $ : ace Cal 
a ae ‘a ° * : : ‘ + i aie 
Brd fifth | 66 | / ce ~~ wes 
~ Ath fifth. 83 ; 
3 a Sth f£itth «62 ; Sosy ! Oe ee 
: : i ° . 
‘ From the Seotl table, 34.65% of those in the top Fifth on thy independ=. ie 
ent varidble can be expected to be in the top £Flfth in the déepengent variable; . 
. 24.4% int the second fifth; 18.8% in the third; 13.95% in the foukyh; and 8.2% b ‘ 
. ih the bottom fé4fth, Similar percentages can be casily computed for those in 
ench “fifth on the inde pendent measure, Once the N's are computed fortall x pea 
, a hn 
: 4 Or ; # . ; | — 
a 
’ 


v . , i 4 
- . ‘ : 7 | : 4 ‘ o . . 
ah . aes . : S 
colts of an § K S matrix, tho sums of tho columns previde the expected. distri# =~ 
>. buttons’ on the dependent measure tn fifths. 


The expucted ‘distributions ob- 
tained in thjs tashion are presented in Table 16, 


together with the actual 
(obtained) distributions, 


. 


at 


‘ . é 
-A Chi Square test can be an appropriate test to apply. to determine the 


' - Bpipnificance of the differences between the expected and obtatned 


stribu- ‘ 
tions, cis 


In the situation where, the actual distribution or independent. variable 
is lower than for the entire class (equal N's in eaéh fifth) and the correla- 
- tion with the dependent variable is positive, the expected distribution will 
plead. Aft ap toward. the near, -Honce. the expected —N in—the. top fifth—is-greater. - 
nh the actual N in the top fifth in the independent variable for SAT-V, 

In those situations where the actual distribution on the independent variable 

bs Wigher than for the entire class, and the correlation with the dependent 

vitetable is positive, the expected distribution will shift down toward the 
. 4. Mean as is the case with SAT-M, EC, and TE or AM (Table 12 and 14), 
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